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Programmed Reading published by Webster Division, McGraw-Hill. 
Book Company (copyright 1963 by Sullivan Associates), was introduced 
into the Burgess Elementary School in Sturbridge, Massachusetts, in 
1966. One class of first graders and their teacher initiated the 
program. In 1967 this teacher (Ilfs. A) again used Programmed 
Reading with her new first grade class. The original first grade 
class continued with this reading series in the second grade with 
their second grade teacher (Mrs. B). In June, 1968, the Ad Hoc 
Sturbridge Reading Committee was formed by the Bureau of Curriculum 
Innovation, Massachusetts Department of Education, and this group 
conducted an evaluation of Programmed Reading as used in the Burgess 
Elementary School. This is the report of the Committee. 

I. LOCATION OP THE STUDY 

Sturbridge is a town in the southwestern corner of Worcester 
County. Its estimated population (as of 1965) is approximately 
4 ., 000. In population it was 216th of 356 cities and towns in 
Massachusetts in the I960 state census. Sturbridge and four other 
towns comprise Elementary School Union #61 and feed into the 
Tantasqua Regional Hi^ School. 

II. STRUCTURE AND RATIONALE OP PROGRAMMED READING 
A. Materials: 

Programmed Reading is a reading system consisting of: 

1. prereading materials; 

2. programmed texts for the children which emphasize 
independent work for the children at their own pace; 



3. test booklets which provide an evaluation for each 
book in the programs 

[).• supplementary story books which are written to parallel 
the vocabulary in the programmed readers so that after 
completing reading book 1 the students may read story 
book 1> etc.s 

5* supplementary filmstrips to precede each programmed 
readers 

6. teacher *s guides for the programmed readers, the test 
booklets, and the films crips | 

7. supplementary ditto sheets to accompany the first 14 
programmed readers and the first 7 story books | 

8. and placement examinations designed to place transfer 
students or remedial students in the appropriate programmed 
reader. 

All of these materials are divided into four series: a prereading 

series, and Series I, II, and III with a total of 21 programmed 



readers • 
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B» Charactoristics of the Systems 

The system is designed to be used as a basic text for begin- 
ning readers and also for remedial readers. The plan is to first 
introduce the written symbols, then teach the relationship of each 
s^bol to the corresponding sounds in words. Those grapheme- 
phoneme correspondences are taught in a highly structured program 
which systematically introduces each relationship and uses a 
controlled vocabulary to emphasize the regularity of these relation- 
ships, Function words of high frequency in the language are intro- 
duced as ‘’sight words” at the rate of two or three per book in the 
first two series of programmed readers (ll|. books) and other ”sight 
words” necessary for particular story content are introduced 
throughout Sories III, 

One of the unique features of the system is the format of the 
readers which are programmed, in the strictest sense of the word. 
Students work independently in the readers and are required to 
give a written response to a segment of text. They then immediately 
chock this response against the answer given in the left hand 
margin of the reader i:hich should have beon covorod i;ith a card- 
board slider. The segments requiring a response become larger and 
more complex in terms of number of grapheme -phoneme correspondences, 
number of unique words, nvunber of words, sentence length and 
syntactic complexity, r.nd nurabor of sontoncos within the segment. 

Details of the sequence and rate of introduction of the letter- 
sound correspondences, the vocabulary, punctuation, etc, are out- 
lined in the flow chart printed by the publisher. The sequence is 
logical and stands up to rigorous linguistic evaluation. 




C. The Teacher * s Roles 



After all children are assigned to and working at the appro- 
priate level of independent work in the programmed readers, the 
teacher *s role is varied. The following suggestions to the teacher 
are cryptic summaries of those found in the teacher *s guide. 

a. Circulate throughout room when children are working, stop- 
ping to ask for oral reading of specific words or sentences, 
and engage in dialogue relevant to the page he is working on 

b. Correct iinit tests within each book for each student as 
soon as he completes the tost and have him read sentences 

orally to you. 

c. Allow students to progress through programmed readers (the 
students* major activity in this program) at their own pace. 

d. Help slower children - listen while they go through their 
independent work, guide their reasoning in answering 
questions, etc. 

e. Analyze students problems and work on those specific needs 
rather than having students redo a book or unit. 

f . Express interest in each child* s work and reinforce his 
independent efforts. 

g. Maintain an attitude toward reading that will be motivating 
to children. 

h. Present now sound-symbol information and related exercises 
in the sequence given in the book. (It is left to the 
teacher *s discretion as to whether to proceed with the 
whole class or with groups, and whether to present this 
information before or after students have worked with it 
in their books.) 



4 . 



i. Give students word discriraination oxorcisos (word recog- 
nition), (Again, and also with through ‘*15*' infra, the 
timing of the presentation of these is left to the discre- 
tion of the teacher, but specific exercises are given in 
the guides,) 

j. Give word formation exercises (spoiling) 

k. Give word review exorcises 

l. Give dictation exorcises 

m. Provide for oral reading of selections from readers and 
discussion of these selections after students have worked 
through passages independently. The type of suggested 
questions progresses from factual (who, what, when, etc, 
in reader 1) to interpretive and inferential, 

n. Provide for oral reading and discourse in storybooks using 
all types of questions, 

o. Encourage creative writing (suggestions in guide) and art, 
D, Story Content ; 

Series I (Books 1-7) describes a few standard characters and 
their pets. Soon in the books the items combine to create a 
paragraph effect. 

Series II (Books 8-14) includes science topics, fairy tales, 
and everyday adventures — some with fantasy. 

Series III (Books 15-21) utilizes topics that are sometimes 
sustained throughout a book. Many stories relate Greek myths. 

For further information on the structure and rationale of 
Proper ammed Reading, see Appendix A, 
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III. INTRODUCTION OP PROGRAMMED READING 



Prior to the introduction of Progrartimed Reading 5 the basal 
reading system in use at the Burgess Elementary School was the 
Scott-Poresman basal readers. This system was being used by the 
non-programmod instruction classes in grades one and two at the 
time of the visit by the Committee. It was not the most recent 
edition of the Scott-Poresman series, but was the 1963 edition. 

In 1966, Mrs. A, a teacher with 22 years of teaching oxpe- 
njjxQ asked several weeks before the school year began to 
teach Programmed Reading . Some assistance was received from a 
consultant representing the publisher. Except for this, Mrs. A 
was largely on her own. Mrs. A attempted to conduct the Programme 
Reading system as described in the teacher *s guide. 

Mrs. B was asked to continue with the same children in their 
second grade class. She was then a teacher with 16 years of expe- 
rience. She reported that she, too, attempted to follow the 

teacher’s guide closely. 

IV. EXECUTION OP THE PROGRAM 

This section describes the program in operation as the 
Committee saw it. 

VJhat have we observed at the Burgess Elementary School | 
Sturbridge, Massachusetts? An air of enthusiasm and commitment 
pervaded the innovating classrooms to an extent whero it became 
most difficult for the team of observers nofto be caught up in 
the contagion of the trial. V/ith a great sense of determination 
and self-reliance, both teachers and students in this innovative 



program mov©d purposefully from bask to task as they sought to do 
"better than their best" in the teaching-learning process. Although 
styles of teaching and learning differed among the Programmed 
Reading classrooms, there were some areas of commonality in evidence, 
and these will be Gn\ameratod bolovj. 

Children worked independently in their readers at their own 
rate. IJhon all the children worked in their readers, the teacher 
circulated about the room in order to provide some individual 
instruction to children as they appeared to need or request help. 

The children seemod to enjoy the illustrations in their texts. 

Skills (auditory and visual discrimination; introduction and 
review of phonic generalizations) x^ere presented to the entire 
class, but wore geared to the average. Pupils working at levels 
lower than this receive further instruction and reinforcement when 
they have reached the point at which the specific skills were 
needed. Children at higher levels receive individual assistance 
from the teacher or another child, or were able to discover the 
principle and master the skill independently because of the struc- 
ture and reinforcement features built into the program. 

The Committee observed samples of the pupils’ creative writings 
which suggested both increased spelling poi^er and facility in 
written expression. Save for the mathematics program, concerted 
effort was made to integrate all of the other content subjects with- 
in the reading program. 

Children were grouped into three or four groups for oral read- 
ing. Stories usually were at the reading level of the poorest 
reader in the group. Stress by the teacher on expression and 
fluency varied. Word - by - word and **round - robin" reading was 



noted, as well as reading with good expression, preceded by questions 
from the teacher concerning interpretation of mood and feeling of 
the characters involved. Some errors in oral reading were observed. 

Teachers reported that after the pre-reading program had been 
completed (in first grade) each child advanced at his own rate 
through each step in the program. Children who completed the entire 
series were using the SRA Reading Lab. Moreover, supplementary 
materials available for independent reading included Reader *s 
Digest Skill Builders, library books, and basal readers. 

V. EVALUATION OP PUPIL’S READING ACHIEVEMENT 

Members of the Ad Hoc Committee visited the Burgess Elementary 
School from June 3 to June 6, 1968. \\Jhlle at the school, first and 
second grade classes using Programmed Reading (P.R.) and the Scott- 
Poresman (S.P.) series were observed^ all teachers of the programmed 
instx*uction classes, most teachers of the conventional classes as 
well as other school personnel were interviewed; test data were 
made available, and several children in the P.R. classes were 
interviewed and informally tested. The results of these efforts 
are the basis for writing this report. The present section of the 
report will concern itself with the interpretation of test data 
and spot-testing of children. 

The reading test scores presented in this section have not been 
analyzed by means of statistical tests (tests, etc.). Because the 
introduction of Programmed Reading in the Burgess Elementary school 
was not set up as an experiment and therefore did not employ rigorous 
controls, the Committee agreed that findings of significant 
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differences could not be interpreted unequivocally in any event# 
Also^ COTiparison to results of classes using the Scott -Pore sman 
books was not intended to determine if P.R# was superior to the 
Scott-Poresman program being used, but merely to estimate more 
adequately the performance of the P#R* children than could be done 
by considering achievement scores alone. An implied comparison is 
made to national test norms throughout the study. For these reasons 
the Committee agreed nov to make statistical tests. 

A. Comparison of First Grade Classes 

The first-grade classes are compared in Table 1. Results on 
the SRA Achievement Series -Multilevel Edition, Pom C, Level 1-2 
(administered in March 1968), the California Short-Porm Test of 
Mental Maturity, Form S, Level 1 (administered in November 196?) # 
as well as chronological age (in months as on November 196?) are 
shown. Excluded are children who are repeating the first grade, 
children who transferred to Burgess School during the year, and 
four children from the S.P. group who were absent at the time I.Q. 
tests and/or reading tests were administered. 

This comparison shows the results of reading instruction 
usi 33 g Programmed Reading (P.R.) in one class and the Scott-Poresman 
(S.P.) series in three other first grade classes. Certain factors 
tend to make this a valid comparison, even though certain steps 
were not taken that would have been taken had these classes been 
organized according to a rigorous research design. Children were 
not intentionally assigned to classes in a manner that would 
clearly have led to non-equivalent groups. Orderly assignment was 
made from alphabetical registration lists. X.Q. and chronological 
age of P.R. and S.P. groups do not differ significantly. The 
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proportion of boys to girls in the tvro groups is fairly similar | 
a slightly but not significantly larger proportion of girls is in 
the P.R. groups (8 boys to 13 girls in P.R. and 29 boys to 30 girls 
in total S.P.). The proportion of children having kindergarten 
experience in each group does not differ significantly (l8 of 21 in 
P.Pi. and Ii4 of 59 in Total S.P.). 

Certain limitations on generalizing from these results must 
be noted. First, there is clearly a difference in the amount of 
teaching experience of the P.R. and the S.P. teachers. Mrs. A, 
the teacher of the first grade P.R. class had 2[j. years of experience 
as of June 1968, however she was teaching P.R. for only the second 
year. The three teachers of the S.P. classes had 3, 7, and 10 years 
of experience. Although quality of teaching is not necessarily 
related to nimiber of years of teaching, the difference in teaching 
experience must be acknowledged. Second, a large proportion of 
children have had kindergarten experience. The kindergarten program 
in Sturbridge is in its second year, and this is the first group of 
first gradors who have profited from this program. Members of the 
Committee who visited the kindergarten reported that it was oriented 
to developing reading readiness. It will be shown later that the 
kindergarten experience may have contributed greatly to pupils ’ 
reading achievement. Third, it must bo noted that all pupils in 
the P.R. class were of average or above average intelligence, 
thereby preventing us from generalizing to below average groups. 
Finally, the reading test used has a ceiling of ij..O. Five children 
in the P.R. group received a score of I}.-:-, whereas no children in 
the S.P. group attained a score of This fact tends to lower 

the mean score attained by the P.R. group. 

er|c 
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In conclusion, it appears that Progromtaed Reading was an 
effective basal reading program for the first graders of average 
or above average intelligence, most of whom had had a kindergarten 
program, and who were taught by an experienced teacher. This 
finding is consistent with the findings of Liddle (13), Ruddell (17) 

Della-Piana (3), and the Denver Studies (5) that showed Programmed 
Reading compared favorably to conventional basal readers (see 
Appendix £) . 

B. Comparison of Second Grade Classes 

The Committee wished to compare all children using Programmed 
Reading for two years with children using Scott -Pore sman for two 
years. This would include children nov; in the second grade and 
children repeating the first grade. However, three children 
originally in S.P, are repeating first grade in the P.R. class. 
Therefore, only second-grade children on whom complete data were 
available are compared. Those not compared were children then 
repeating first grade (one from P,R, and seventeen from S,P, at the 
end of first grade), children who had repeated an earlier grade, 
children who transfered into the school within the two years, and 
one child from the P,R, group on whom test data wore incomplete 
because of absence at the time of testing. 

Table 2 shows results on the SRA Achievement Series -Multilevel 
Edition, Form C, Level 1-2 (administered in March, 1960)5 the Cal- 
ifornia Short-Form Test of Mental Maturity, Form S, Level 1 
(administered in October 1966) | as well as chronological age (in 
months as of October, 1967. 
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The groups do not differ significantly in I.Q. and chronological 
ago. The proportion of boys to girls in each group does not differ 
significantly (13 boys to 6 girls in P.R. and 20 boys to 13 girls 
in S.P.). The P.R. group was not significantly different in read- 
ing achievement from the S.P. group. When these children were 
initially assigned to first grade classes^ no bias was intentionally 
introduced at the time of this assignment; orderly assignment was 
made from alphabetical registration lists. But the present P.R. 
and S.P. groups may not be equivalent in some respects because of 
transfers from Burgess School at the end of first grade and because 
of the number of retentions in the first grade. In addition, it is 
to be noted that foui* first grades were consolidated to form these 
three second grades, with the S.P* classes initially having larger 
class enrollments. 

Other factors to be considered in interpreting these results 
are as follows. The second grade P.R. teacher had 17 years teaching 
experience (as of Juno, 1966). The S.P. teachers had 16 and 23 
years experience. In regard to experience, S.P. teachers can bo 
considered at least equivalent to the P.R. teacher. However, the 
second grade children had spent a year with first grade teachers as 
well. The P.R. children (who had ttrs. A in first grade) may have 
been in a favored position in comparison to some of the second grade 
S.P. children whoso first grade teachers had fewer years of expe- 
rience than Mrs. A. (These are not the same teachers the present 
first grade children have) . Another factor is that none of the 
second grade children had kindergarten experience, as Sturbridge 
had no public kindergarten program when the second grade children 



were of kindergarten age. A third factor is the nature of the test 
scores » themselves. The reading test used has a ceiling of I)..0. 

All groups scored rather close to that ceiling; many children 
received a score of « This fact tends to make it difficult to 
show real differences that may exist between the groups. Table 
3 shows the number of second-grade children in each group scoring 
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TABLE 3 

NUMBER OP SECOND-GRADE CHILDREN SCORING I|.+ IN READING 



Reading Program 


Total n 


Number Scoring 


P.R. 


19 


9 


S.P.-l 


17 


5 


S.P. -2 


16 


7 



As a further check on the equivalence of children who scored 
i|.+ in total reading, comparable students from P.R. and S.P. groups 
were given the Gray Oral Reading Test Form A. The children chosen 
were comparable according to I.Q., chronological ago, and sex. 

Data on these children are presented in Table 1^., 
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Of the P.R. children tested, the highest ceiling was estab- 
lished at the grade 6 passage. Of the S.F. children, the highest 
ceiling was established at the grade 3 passage. The examiner 
observed that the P.R. children were able to attack more words 
than the S.F. children. However, they did not do better in the 
comprehension chock than did S.F. children. Also, S.F. children 
made far more omissions than P.R. children tested { a total of 36 
and 13 respectively) although thoy road fewer paragraphs. 

Mean reading scores on the SRA Achievement Tost and level of 
performance on the Gray Oral suggest that Programmed Reading was 
a satisfactory reading program for the second-grade children in 
the P.R. group, yielding results that wore at least as good as 
those obtained by children taught with Scott -Fore sman. 

It is recommended that the present first grade children be 
followed carefully in the second grade. Children retained in first 
grade, if retained in the same basal reading program, would enable 
a clearer evaluation of second year progress. Both second graders 
(in 1969) and first grade repeaters should then be tested with an 
instrument having a higher ceiling. 

C . Progress Made in the Second Year of Programmed Reading 

It is of interest to note the amount of gain made during the 
second year of using Programmed Reading. The major limitation in 
interpreting those results has already been explained above, viz. 
the ceiling on the second grade achievement test is too low; 9 of 
the 19 children scored I|.+ . Table $ compares the reading scores on 
alternate forms of the SRA Achievement Tost given in 196? and in 
I960 for the second grade P.R. group. Included are the 15 of the 
19 children for whom first grade achievement scores wore recorded. 
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TABLE 5 

FIRST AND SECOND GRADE READING SCORES OP 
THE SECOND GRADERS IN THE P.R. GROUP 



Pupil 


Total Reading Scores 


Gain 


First Grade 
66 - 67 


Second Grade 
67 - 68 




1 


2.k 


0*J* 


1.6+ 


2 


3.2 


3.8 


0.6 


3 


2.8 


l+.o-i- 


1.2+ 


i|- 


2.8 


I|..0+ 


1.2+ 


5 


1.5 


2.6 


1.1 


6 


2.3 


i+.0*J* 


1.7+ 


7 


2.1+ 


3.5 


1.1 


a 


2.8 


i|..0-:- 


1.2+ 


9 


2.2 


3.7 


1.5 


10 


1.6 


3.7 


1.9 


11 


2.1 


1+.0+ 


1.9+ 


12 




3.6 


1.2 


13 


3*k 


i|..0+ 


.6+ 


III. 


2.5 


4.0-j- 


1.5+ 


15 


2.1+ 


3.5 


1.1 


Moan 


2.1).7 


3.76+ 


1.29+ 


S.D. 


49 


.38 
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D • Mrs, A^3 Results iirith Scott-Forosman and with ProgreoHmed 
^^eading : 

It was thought desirable to compare Mrs, A*s results with 
Scott-Poresman and Programmed Reading in order to better control 
the factor of teacher differences. Therefore, we compared the 
reading scores of Mrs, A*s last Scott-Poresman class (tested in 
Spring, 1966) and her first Programmed Reading class (tested in 
Spring, 1967). The latter group includes children in Mrs, B’s 
second grade class (Table 2 and 5), first grade repeaters at the 
time of the 196? testing, and children who did not enter Mrs, B's 
second grade class at the end of the 196? school year. These 
classes include children repeating first grade and children who 
may have loft the regular track for placement in Special Education 
Classes, I,Q, scores were not obtained. The comparison, therefore 
is merely suggestive. Data are presented in Table 6, 
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TABLE 6 



COMPARISON OP MRS. A*s LAST S.P. CLASS AND HER FIRST 
P^R. CLASS (66-67) ON FIRST GRADE READING SCORES 



i 

Reading 




Total Reading Level 


Program j 


n 


Mean S.D. 


♦ 


S.P. 


23 ; 


2.26 .66 


P.R. 


25 ^ 

* * I 


2.2l^ .66 



These data fail to lend support to the results presented earlier 
which suggested that Programmed Reading may have been more effective 
than the Scott-Poresman program. This discrepancy with earlier find- 
ings may be due to the unreported and uncontrolled variables concern- 
ing the two classes compared (as enumerated in the preceding para- 
graph) or to the fact that neither class had kindergarten experience. 
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E. Possible InfluoncQ of Other Factors ; 

It is possible that Prograinmed Reading becomes moro effective 
than Scott-Poresman when it follows a structured, readiness -oriented, 
kindergarten program in which letter sounds are taught. To examine 
this possibility, it is helpful to compare the reading achievement 
of first graders in the Spring of 196?, excluding repeater, with 
that of first graders in the Spring of 1968. This comparison may 
enable us to discern the influence of kindergarten experience and/or 
possibly, the influence of a year's experience with teaching P.R., 
neither one of which can be estimated separately in this report. 

To some degree wo can make this comparison by examining Tables 
1 and However, unlike Table 1, Table 5 includes only children 
who wore promoted to second grade. Since this limitation may give 
a high estimate of the 196? first grade mean reading score by 
eliminating children who were not promoted, the apparently higher 
mean score of the present first grade (Table 1) suggests that 
kindergarten experience and/or the added year’s experience in 
teaching P.R. facilitates pupil progress with P.Pi. 

P. Further Analysis of Data : 

Further analysis is made possible for the reader by consulting 
Appendix 0 whore data presented for individuals in P.R. Pupils are 
ranked according to the book they are using in P.R. and data on 
C.A., I.Q. and sex are included. Pupils listed are those represented 
in Table 1 and 2. 




VI. Advantages of the Sullivan Programmed Instruction 

over the Scott-Porosman Program 

Our initial impression of the two P*R* classes was 
one of students working diligently. They seemed to have a clear 
idea of their assigned responsibility and were able to carry out 
these tasks with a minimum amount of teacher assistance. ¥e saw 
evidence of students working together, and in the second grade 
class we saw children helping other children both at student invi- 
tation and by teacher assignment. Consequently, the teacher was 
free to work with groups and individuals more than in the conven- 
tional groups. The children in the two P.R. classes were noticeably 
less dependent upon their teacher when doing individual work than 
their counterparts in the five conventional classes. This observation 
was sustained and reinforced throughout the time of our observations. 

The students in each P.R. class worked quietly in a determined 
manner while their teacher went from student to student helping 
them with their immediate task. This is not to imply that the 
children in the conventional group did not work well, for this was 
not the case5 but the programmed group children were called upon 
to work alone for much longer periods of time. The teacher in the 
second grade programmed group took considerable time--tcn to fifteen 
minutes— to talk to visitors. As usual, the children worked 
quietly at their seats. 

The students in the programmed first grade class were working 
on material which ranged from level 3 to level 13. There are 
twenty-one levels in the three-year programi with level 21 approxi- 
mately the end of third grade according to tho publishers. In the 
second grade the range went from 8 to 21 with four students who had 
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finished the program* This would mean that this second grade had 
students ranging into fourth grade reading materials. The programmed 
groups were spread over a wider range than the conventional groups 
in the same school grade. Furthermore, the top students in the 
programmed groups were working in more difficult material than their 
co\interparts in the conventional groups. This may be accounted for 
by the fact that the students in the programmed group can progress 
as fast as they are motivated to do so. The S.P. group children 
progressed at the rate of their reading group. The pace here is 
determined by the teacher. The S.P. groups spent more time listen- 
ing to the oral reading of their peers and in guided reading where 
the teacher would ask a question, and a student would respond to 
her. There was little student -to- student interaction except in one 
of the S.P. second grades. Here the students acted as ‘'teacher’'’. 

We observed that all students working through the P.R. material 
dis so in the same sequence* The differences had to do with the 
rate of progross through the sequence and the amount of help they 
needed from the teacher or other children. 

The quality and quantity of written language evident in the 
classroom at the time of our visit favored the programmed group. 

This seemed to be a major factor in influencing many of the conven- 
tional group teachers to desire to use Programmod Reading . The 
children's writing ability also helps account for the teachers' 
reluctance to return to the currently used basal reading program. 

In the second grade P.R. group the teacher found that the 
spoiling program used in the school was more than adequately covered 
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by Programmod Reading ^ and sho no longer used it with tho progroMmed 
group. Our observations indicated that tho programed group chil- 
dren did in fact show a high degree of accuracy in their written 
work. 

The advantages may be summarized as follows. Children using 
Programmed Reading learned to work independently for long periods 
of time. Independent work in their* programmed readers taught them 
new vocabulary and reading skills and also provided an opportunity 
for overlearning, l^eroas grouping in S.P. required some pupils 
to use a basal text that might be somewhat easy or difficult for 
them, assignment to a programed reader enabled each pupil to work 
in a book at the appropriate level of difficulty. Rate of progress 
was determined by the individual’s ability, rather than by group 
membership or by the teacher's decision. Pupils wore permitted to 
progress as far as they could in grades one and two, whereas in 
S.F. it was oxpocted that the third grade teachers would resume 
insturction at the beginning of the third grade reader for tho best 
readers. VJritton work of the P.R. children appeared to bo very 
satisfactory. 

VII. LIMITATIONS OP PROGRAMMED READING 

Spot chocks of tho reading of several children showed certain 
discrepancies between expected and actual performance. In some 
cases, children made word recognition errors when asked to read 
orally from their programmed readers. It is not known whether these 
are more serious or frequent than errors made by children using 
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convontional basal reading sorios. Also, it was found that some 
children could not road with expoctod accuracy from a second grade 
Scott -Pore sman reader although they were using Scries III P.R. books. 
Therefore, the Committee suggests that if children are expected to 
read trade books or stories in basal readers to supplement Programmed 
Reading , teachers should poriodically ascertain pupils* independent 
reading levels in these materials. 

Closer supervision of children* s independent work scorns neces- 
sary to assure growth in i/ord recognition and in comprehension. 

The typical response made by a pupil when using Programmed Reading 
is writing a word. It is necessary to assess his ability to road 
that word as well as the surrounding context. Often, correct written 
responses can be given tirith no assurance that the pupil is responding 
to the material as the authors intended. This observation is con- 
sistent with the findings of McIToil (II4.) concerning the desirability 
of oral responses to stimulus words in programmed reading instruction. 
Also, possible negative effects ondavelopmont of comprehension may 
occur when a child may see that his answer was incorrect but not 
know why. ¥0 observed this in the P.R. classroom and also noticed 
that there xras no provision to encourage him to analyze his ansx^rer 
and the correct one. 

Children whose independent work is far above or boloxj the level 
of class teaching of skills or oral reading may possibly bettor be 
able to spend their time at another activity. It seemed to the 
Coramittee that skill teaching and oral reading instruction in smaller 
groups of children reading at more nearly the same level would bo 
preferable to whole class lessons used by the P.R. teachers. 
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Although programmed instruction seemed superior to conventional 
instruction in enabling children to read at an appropriate level 
of difficulty, whole class teaching of skills seemed inconsistent 
with this desirable feature. Even though the teacher's manual does 
not instruct the teacher to give specific skill lessons only to 
children at a particular level, it may be desirable to teach specific 
skills to small groups leather than to the whole class. 

More provision than was given to those pupils should be made 
for opportunities to engage in oral reading activities which would 
bring such end-results as discussion, sharing ideas, developing 
thinking skills (especially interpretive, critical, creative, and 
elaborative thinking). The teacher's manual encourages teachers to 
call several children together for discussion groups if time is 
available. The Committee strongly suggests that time be made 
available in order to insure reading for comprehension and interpre- 
tation. 

An important decision to be made by Sturbridge or any school 
system using P.R. concerns selecting an adequate follovj-up to P.R. 
in grades three or four and beyond. In any program that is imple- 
mented through the following grades, there should be a continuation 
of the skills and strengths gained from the P.R. system. Because 
of the characteristics of P.R. described elsewhere, reading materials 
used in a follow-up program should provide continued development of 
word moaning vocabulary, comprehension, and study skills. A school 
system might consider using a newer basal reader approach, one that 
does not restrict its vocabulary according to a word frequency count 
principle, and will permit children to continue to develop in word 
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recognition ability* The teachers who will be involved should 
explore available materials and programs, then choose the program 
or programs they consider most appropriate. Third grade teachers 
should bo prepared to continue P,F., with those children who have 
not yet completed the program, and move children to the follow-up 
program as they complete P,R, Children should enter the follow- 
up program at their actual reading level, 

A school system desiring to use P,R, or a similar basal reading 
program will have to be aware of the financial cost of the program. 
Because of the cjuantity of materials which are consumable, P,R, may 
be more expensive than the conventional basal reader program. The 
use of plastic overlays permit the reuse of programmed readers and 
reduces the expense of this reading program. 
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APPENDIX A 

Harvard Office of Programmed Instruction 

May 28, 1968 

Review of Programmed Reading (McGraw-Hill, 1968) 

The following review was done by the Harvard Office of Pro- 
grammed Instruction expressly for the Ad Hoc Sturbridge Reading 
Committee. The review is based on an examination of the program 
according to our standard evaluation procedure and is based on 
various supporting documents as well* The review is not meant to 
either endorse or discourage use of the program; it merely offers 
comments to people considering the program for their own use. 

For anyone interested in selecting an elementary-school pro- 
grammed instruction text in reading. Programmed Reading ranks near 
the top of the list of texts to be considered. There are other 
programmed instructional materials in reading and language arts, 
but Programmed Heading has been more widely used and seems more 
likely to be successful than the other texts* 

! Design 

Programmed Reading is designed to emphasize the regularities 
of the language by controlling vocabulary* At each stage, it intro- 
duces words chosen to illustrate a new phonic principle, gradually 

1 

I increasing the number and complexity of those principles* 

Given a strict vocabulary control, the text manages to be 
quite interesting* Sentences are natural-sounding and varied, often 
describing funny or interesting situations* Illustrations are at- 
tractive. Whole sentences are used almost from the beginning, to 
promote the use of context clues as well as to increase interest. 
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The workbook format calls for the pupil to retd a sentence or 
two, then check his understanding by answering a question or com- 
pleting a phrase. The amount of uninterrupted text increases until 
the pupil is reading a long paragraph before answering an item. 
Supplementary filmstrips and storybooks are designed to review the 
vocabulary of the workbooks. 

The series is designed to allow each pupil to work independ- 
ently at his own pace. However, the group review activities (film- 
strips, suggested chalkboard exercises) would lead to some conform- 
ity of pace, especially if the group is large. 

Intended Audience 

Programmed Reading has had considerable success with bolow- 
average as well as average students; however, for very slow students 
the teacher may need to devise extra review. The series is best 
used as a major instructional program not as a specific short-term 
remedy for an isolated reading weakness; it is not broken down 
into separate phonics lessons but interweaves new material and re- 
view into one major sequence. 

The Teacher *s Role 

The prereading materials call for group work. The first les- 
sons, on letter names, are given entirely by the teacher; the Primer 
is in workbook format, with the teacher introducing the new format. 
After this, pupils do much independent work but frequent checks on 
their progress should be made by the teacher. Several gray-bordered 
test pages are interspersed in each book; the teacher should watch 
the child do these and have him read some items aloud. The teacher 
also needs to supervise regularly to be sure that pupils cover the 
answer column and that they road the entire sentence or paragraph 
before filling in the answer. 
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Possible Adaptions by the Teacher 

By Book 5 , the pupil is expected to learn a new phonic prin- 
ciple by seeing it illustrated in just a few words, and then to use 
that principle to decode many now words. If a pupil fails any unit 
tost, it is important to give him extra review before sending him 
on to more difficult material. Filmstrips, storybooks, and Webs tor- 
master (ditto) exercises offer review; ideas for other exercises 
are given in the Teacher's Guido, The ''word families*' exorcises 
(in Teacher's Guido) have been found very helpful and probably 
should be done by most children. 

At the very beginning of the series, the child is expected to 
learn the names of all letters, in both upper and lower case, before 
learning any words. This seems very tedious and very taxing to a 
yo\mg child's memory. One alternative is to teach only the 8 let- 
ters the child will need to read the Primer, then use the Primer 
normally, then teach the letters of Book 1, and so on. 

Publisher's Revisions 

September 1968 is the distribution date for revised versions 
of the Proreading materials. Books 1-15> and Teacher's Guidos to 
them. The publishers describe the revisions as: 

1, A change in design of the Prereading materials to introduce 
letters gradually (as described under possible adaptations 
to the existing materials). The Prereading stage will in- 
clude Reading Readiness (names and so\mds of a,i,m,p, t,n) , 
followed by a Preroader (reading of 16 words containing 
these letters, writing sentences no relation to the exist- 
ing Preroader) , 
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The existing Preroader (review for slower learners) will 
bo replaced by Book lA, to bo used after Book I. 

2 . An increase in the amount of review in Books 1-15> includ- 
ing 40 ^ more response items in the text and suggestions in 
the Teacher *s Guido for more teacher-directed group activ- 
ities* 

3, Fewer within-books tests; one every 36 pages instead of 
about every 22 pages* 

4* The addition of a Nogro boy to the cast of characters in 
the text * 

The now materials were not available for evaluation, but the 
plan of revision seems very good, with the possible exception of 
#3: the teacher *s chocking of each pupil *s progress is very impor- 

tant and probably should not bo decreased* Since there will be 
fewer tests in the new materials, the teacher may find it necessary 
to make spot chocks between tests* 
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APPENDIX B 

Bockmeyer, T. ''Application of Programmed Instruction to Remedial 

Heading for the Deaf.'* Volta Review ^ 65 (October 1963) » pages 

i|.l5-l|.17. 

Summary ; Programmed materials for teaching reading to hearing 
children wore used in an experimental remedial reading program in 
a school for the deaf. The success of the program with one group, 
as compared with the control group, indicated the feasibility of 
using programmed material dosignod for hearing students in teaching 
the auditorially handicapped. The study was conducted at Mill Neck 
Manor Lutheran School for the Deaf, Long Island. 

Material : Throe units of linoar-typo remedial reading program, 

published by Center for Programmed Instruction, Now York. The 
program asks for an entry reading level of 3*0* 

Procedure ; Ton students wore chosen for study. Group A (5 students) 
was designated as a high ability group. All students in this group 
road above a 3.0 level, with a mean of 3*7 on the California Reading 
Tost. Group B (5studonts) was designated as a low ability group. 

The range of reading abilities of this group was from 1.9 to 2.9, 
with a mean of 2.2. The procedure was identical for both groups as 
they proceeded through the material. 

Results : Gain Scores were significantly higher for the high ability 

group than for the low ability group. 

Interpretation ; Group A did significantly bettor on the posttest 
primarily because they met the entry criterion of the program. 

Deaf students can benefit from programmed material 
which has been designed for hearing students. 
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Burkott^ Ann P«, and Clogs, Aiabroso A, Jr«, '’Prograuimod vs. Basal 
Readers in Remedial Reading.” The Reading Teacher , 21 (May 
1968), pp. 74.5-711.8. 

This study compared two methods of teaching reading in a remedial 
situation as measiH»ed by the behavior of the subjects in silent and 
oral reading tests and in spelling. The two methods were the Sul- 
livan Associates Programmed Reading and the Betts Basal Readers. 

Null hypotheses were formulated concerning silent reading, oral 
reading and spelling proficiency. 

Sample and Procedure ; Forty mild cases of reading retardation were 
randomly assigned from a retarded reading population of 152 subjects 
in grades one, two, and three in two elementary schools in Westfield, 
Massachusetts. Experlmenta.1 and control groups wore seb up in each 
school for the instruction period of four months. One group in each 
school was administered a series of pretests while all four groups 
x^ere administered posttests in this four group design. 

Results ; No significant differences were found among groups on the 
measures of oral reading, silent reading, or spelling. All three 
null hypotheses were accepted. 
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Della-Piana, Gabriel. '’Ma^cimizing Effectivonoss of Programmed 
Reading. ■’ Manuscript, 1967* 

Svmimary : The study compared the effectiveness of Sullivan Associates 

Programmed Reading and the ’’currently used basals” in first grade 
classrooms in Salt Lake City. 

Hypothesis ; Null hypothesis concerned reading gains as measured 
by standardized reading tests of vocabulary (Gates, MacGinitie) and 
comprehension (Primary Reading Test). Writing samples were also 
measured for Ntomber of Words, Number of Dopendend Clauses, and T- 
Units. 

Procedure ; Programmed Reading was installed in twelve classrooms. 
Eighteen control classes using basal readers were randomly selected 
from among first grades in the district. Each teacher was observed 
to help maintain fidelity to use of the program as outlined. Con- 
trols were observed also to avoid the Hawthorne effect. One phase 
of the analysis involved a breakdown of all pupils into high, middle, 
and low ability groups based on testing on the Murphy-Durrell Reading 
Readiness Analysis Total Score. Criterion tests were administered 
in February and May. 

Results ; There were significantly greater gains favoring the 
experimental group for the hi^ and middle ability students on 
vocabulary and comprehension in tho February and May tests. There 
was no significant difference between the low-ability students of 
experimental and control groups. On the writing sample the number 
of words used in a story was not significantly higher for high 
ability pupils of the experimental group even though it was higher 



for middle and lovj-ability pupils of the experimental group. There 
were no significant differences on the Clause Index or the T-Unit 
in the final testing. 

Interpretation ; Programmed Reading yields achievement gains equal 
to or greater than currently used basals on measures of vocabulary 
and comprehension. The use of Programmed Reading positively affects 
the number of words used in original writing, but it has no signif- 
icant effect on sentence complexity. 



•'The Denver Studies A Report of Eight Studies Compo.ring Prograinmed 
Reading With Other Reading Instruction Systems in Grades One 
and Two 5 a publication of McGraw-Hill Book Company, October, 
1967, pp. 

Summary ; Seven first grade classes (N = 1^2) in two schools part- 
icipated in the experiment using Sullivan Program. Ten first grade 
classes x^ere chosen randomly from similar schools to serve as a 
control group (N = 325), using a basal reading program. The two 
groups had indentical mean ages (77 months) and nearly identical 
mean IQ scores (E = 93, C = 95) • At the completion of one year of 
instruction, all students were tested on the Metropolitan Primary 
Reading Test, with subtest scores of Word Knowledge, Word Dis- 
crimination, and Reading Comprehension. The Experimental group 
did significantly (.001) bettor on all three areas of the tost. 

A further brealcdown of performance of both groups by IQ into low, 
middle, and hi^ subgroups revealed that of the nine scores (3 
groups, 3 test variables), comparisons showed that middle and hi^ 
ability groups benefitted proportionately more from the programmed 
materials. Older children did slightly better than younger chil- 
dren, but there were no significant differences in perfomance 
between boys and girls. 
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Jeannes, Sister Mary, R.S.M. ‘’Prograinmod Reading; How Successful?'’ 
Journal of Prograimified Reading , a publication of McGraw-Hill 
Book Co., 3» PP» 1-2*^. 

Procedure ; Seventy first grade students from St. Francis Xavier 
School, Grand Rapids, Michigan, were matched on the basis of IQ 
(California Mental Ability tost) and assigned to either the 
experimental or control group. IQ range vxas from 134 The 

35 children in the experimental group used Sullivan Associates Pro- 
grammed Reading as the basic text. The Faith and Freedom Series 
published by Ginn and Company was the basal program for the control 
group. Both groups used supplementary materials in addition to 
their basic program. Teachers were considered to bo equally 
qualified. 

Hypothesis ; More than one hypothesis was advanced, but because 
this is a preliminary report, statistical findings are given only 
for the null hypothesis concerning the tuo programs. 

Results; The study began in the fall of 196I|.* The Gatos Primary 
Reading Tost was administered to both groups in January 1965. The 
experimental group had a moan score of 36.1 and the control group 
a moan of 63.1, a t-value significant at the .001 per cent level. 
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Liddlo, William, 'Colorado Springs Tests Programmed Reading, 

Journal of Programmed Reading , a publication of McGraw-Hill 
Book Co,, 6, pp, 1-6, 

Summary ; Pour schools wore selected to participate in the experi- 
ment in Colorado Springs, One classroom in each school used Sul- 
livan Associates Programmed Reading materials for the teaching of 
reading to first graders. These were designated the experimental 
groups, A second classroom and a different teacher were designated 
as control group to continue teaching with the McKee basal reading 
series published by Houghton Mifflin Company, Reading scores on 
the Metropolitan Achiovomont Primary I Battery were compared for 
the tvjo classrooms in each school and total scores were compared 
for the four experimental and four control groups at the end of the 
school year (1965-1966), 

Hypotheses ; That there would bo no significant differences between 
the Experimental and Control groups in word knowledge, word dis- 
crimination, or total reading at the end of instruction. 

Procedure ; The total number in the Experimental group was 1145 the 
total number in the Control group was 113* There were 62 girls and 
52 boys in the Experimental group and a like numbor in the control. 
Instruction was given for I 80 days in the prescribed manner that is 
suggested in the use of the materials. The eight teachers involved 
in the experiment had varying amo\mts of experience (from 1 to 25 
years), but all wore considered to be fine teachers, Hox^over, the 
median experience of tho four experimental teachers was 11 years. 
The median experience of the four control teachers was 3 yoars. 
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Although all first grade children had taken the Metropolitan 
Readiness Tost at the beginning of the school yoar, it was impos- 
sible to further utilize this test in the experiment because so 
many students had moved in and out of the school during the year. 

IQ tests wore not utilized because scores could not be made avail- 
able for all students. 

Results ; Although the results varied in each school, any signif- 
icant differences wore always in favor of the Experimental group* 
IJhen all groups wore combined, there was a difference significant 
at the .02 level in word knowledge, favoring the Experimental group*. 
There was a difforenco at t! e .01 level between tho two groups in 
both i^ord discrimination and in total reading, favoring the Experi- 
mental group. 

Interpretation ; Tho instructional progrom as carried on by moans 
of Programmed Reading liras either as good as tho basal reader, or 
in some instances better* Those results must bo considered in 
light of tho fact that the experimental teachers had Ij., 9, 13# and 
111 years of experience* The control teachers had 1, 2, I 4 ., and 25 
years experience* 



McNoil, John D. ''PrograuiiTiod Instruction as a Resoarch Tool in 

Reading: An Annotated Case, Journal of Programmed Ins true tj^on^ 

1 (Spring 1962), pp. 37-42* 

Research involved programmed instruction designed to teach 40 words 
singly and in sentences • 

Hypothesis : . .Beginners in reading x^ho wore taught x^ord recogni- 

tion by a method which required oral responses to stimulus words 
would learn to recall, identify, and comprehend more printed words 
and sentences than those children who must respond appropriately to 
the stimulus words without saying them aloud. (p. 37) 

Conditions : Daily l5-minuto sessions for throe weeks. l88 repre- 

sentative kindergarten children (IQ. range 67-138) randomly assigned 
to two matched oral and non oral groups, subdivided into 26 teams 
in 3 schools. Language lab cubicle and response panel wore used 
and taped commentary provided instruction. Oral group used a 
microphone and responses were monitored. 

Postteat : Group multiplo-ohoico, 5l-itom tost in which all 40 

words wore tested. 

Results: Oral Nonoral ( Uninstruoted Control ) 

X=31 X=25 X=12 

t = 4.8, P. > .01 level 

Also found that males learned significantly more than females 
through the programmed instruction (t ~ 3*65> significant at .01 



level) • 



Author's Evaluation ; 'Complotion of the program by 26 different 
teams in three different schools constituted replications of the 
experiment. That the same results wore obtained in each situation 
is evidence that the findings are reliable and testifies to the 
standardization of treatment. The controlled procedures permitted 
even identical intonation and pacing of verbal content in lessons 
given to all children. . . . Unlike most findings from classroom 
experimentation, this study did not reflect the degree of enthu- 
siasm of the teacher or the determination to make the method sue- 

coed#” (p# lj.1) 






o 



McNeil, John D. ”Prograimned Instruction Versus Usual Classroom 

Procodures in Teaching Boys to Head* American Educati onal 
Research Journal , 1 (March 196I|.), pp» 113-H9* 

Tested the hypothesis that teachers behave differently toward boys 
and girls and that such teacher behavior is related to performance 
in beginning reading* Kindergarten pupils were taught i|.0 words by 
an autoins true tional approach, and word recognition measures were 
used to determine sox differences. Children wore then tested on 
word recognition skills after four months of instruction with 
female teachers in first grade* Ivlion reading was taught by female 
teachers, girls were superior on the word recognition measures* 
However, contrary to the usual expectations of female superiority, 
the boys outperformed the girls when auto-instructional techniques 
were employed, which suggests that consideration should be givon 
to the appropriateness of traditional classroom procedures in teach- 
ing reading to boys* 



I|.6« 

Malpass, Loslio F., and others. '’Automated Instruction for Retarded 
Children.” American Journal of Mental Deficiency s 69 
(November 196i|.), pp. 405-412. 

Contrasted two automated procedures for teaching word recognition 
and spelling skills to educable mentally retarded children with an 
individual tutoring method and conventional classroom instruction. 
Institutional and public school children were matched and reindomly 
assigned to the instructional groups. Seventy- two words wore 
selected from 100 in the Dolch-Buckingham Vord List. The two 
automated groups made the greatest gains on the 28 nonprogramed 
words from the list of 100 words. Gains for the tutorial group 
were equal to those obtained using automated procedures, but reten- 
tion was not as great. 



Ruddoll, Robert H. ’’The Effect of Pour Programs of Reading Instruc- 
tion with Varying Emphasis on the Regularity of Grapheme- 
Phoneme Correspondences and the Relation of Language Structure 
to Moaning on Achievement in First Grade Reading#” 1965* U.S# 
Department of Healthy Education and Welfare, Office of Educa- 
tion, Cooperative Research Project #2699. 

Sxammary : An investigation of the effect on word recognition and 

reading comprehension of two published reading programs and the 
effect of supplementing these two programs by materials designed 
to build awareness and understanding of language structure as 
related to meaning. As one of the two published programs he chose 
the Sullivan Associate Programmed Reading series for vocabulary 
materials utilizing to a high degree consistent grapheme -phoneme 
correspondence. For the contrasting program he chose a basal read- 
ing series which makes little provision for consistent grapheme- 
phoneme correspondences in the vocabulary which is introduced. For 
this study, pupils in twenty-four first grade classrooms in Oakland, 
California participated. These classrooms wore selected so that 
there would be a wide range of socio-economic characteristics ropro- 
sentod in the population of 553 students. 

Hypothesis 1 . That first grade reading programs with a high degree 
of consistency in grapheme -phonomo correspondences would result in 
singificantly higher word reading, word study skills and regular 
word identification achievement scores. This hypothesis was tested 
by comparing scores on standardized tests of the experimental and 
control group students. 











Hypothesis 2 , That I’eading programs with special emphasis on 
language structure as related to meaning will result in signifi- 
cantly higher paragraph meaning comprehension and sentence meaning 
comprehension achievement scores* To test this hypothesis > both 
the Programmed Reading and the basal program were supplemented 
with special materials* 

Results ; At the end of one year of instruction, the students were 
tested on the reading subtests of the Stanford Achievement Test and 
other tests of Sentence Meaning and Regular Word Identification* 

The Programmed Reading groups scored significantly higher than 
the basal reader groups in tests of word reading and regular-word 
identification* The Programmed Reading groups to whom the additional 
supplementary instruction vjas given, significantly outscored the 
augmented basal Instruction groups in word study skills as well* 

With respect to outcomes obtained in paragraph meaning compre- 
hension achievement scores and sentence meaning comprehension 
scores. Programmed Reading plus the emphasis in language structure 
resulted in significantly higher paragraph meaning and sentence 
meaning comprehension than the Programmed Reading without the 
^mphasis* This same effect did not occur in the basal augmented 
versus basal alone programs* 

Prom ^ *A Report of Eight Studies Comparing Programmed Reading With 
Other Reading Instruction Systems in Grades One and Two , a publica- 
tion of McGraw-Hill Book Company, October, 1967, pp. 7-9* 



Also in Reading Teacher, 19, (May 1966), pp* 653-660* 
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